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ABSTRACT 


The objective of this study was to compare alternative 
approaches to the cost-effectiveness analysis of a technologi- 
cal change at the Naval Air Rework Facility, North Island, 

San Diego, California. Previous studies were reviewed and 
updated. Econometric techniques were employed to develop 
additional methods. Fach of the methods was used to predict 
@ests Lor situations both hefore and after the technological 
change. These predictions were compared as to their impli- 
cations concerning the cost-effectiveness of a computerized 


work-in-process management information system. 
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After changes have heen made in the operating procedure 
G@fean industrial organization, the question arises, "Wes the 
ehmange worth the cost?” That cost may be couched in terms 
@t ertfort, time, friction, inconvenience or, most likely, 
money. This thesis will be concerned with addressing that 
question, as well as one that naturally follows: "Now, how 


believable is the answer given?" 


A. BACKGROUND 

Since the beginning of calendar year 1972, the Naval Air 
Rework Facility, North Island (NARFNI), has been engaged in 
the test and use of an industrial management information 
system known as the Work In Progress Inventory Control 
System (WIPICS). As implied by its name, NARFNI is one of 
seven Naval Air Rework Facilities (NARF) which are respon- 
Sible for reconditioning U.S. Navy and Marine Corps aircraft. 
Such reworking includes the overhaul, modification, modern- 
ization, preventive maintenance, and repair of a number of 
different kinds of aircraft and included components. It also 
serves a small number of aircraft and components each year 
from the Air Force and Coast Guard, where such aircraft match 
Navy models. The NARFs operate from the Navy Industrial Fund 
(NIF) which provides their operating capital base. Customers 


of the NARF services are charged against their operations and 
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maintenance funds (typically) for the rework services on 
either a cost-reimburseable or fixed price hasis. The 
majority of the work is of the fixed price variety, a provi-~ 
sion which is intended to promote cost-minimization at the 
NARF. Neither growth nor depletion of the NIF is desired, 
so the NARKB are expected to maintain zero profit on their 
operations. 

The introduction of WIPICS, then, represented a technolo- 
gical change at NARFNI in the method of managing its in- 
process workload. The change was unigue to NARFNI in that 
WIPICS was not installed in the other NARFs. WIPICS is a 
computerized information system which receives input data 
from many different control points in the rework process 
concerning the many different jobs heing accomplished on 
inducted aircraft and their components. At each of a myriad 
of well defined disassembly, rework, repair, —aeeeGn 
assembly and test junctures, coded status reports are entered 
mito the electronic files concerning each aircraft or com- 
ponent. Input is made via push-button telephone sets located 
~_aroughout the plant complex. Information concerning the 
status of a specific aircraft undergoing rework can he 
retrieved from storage and cutput through the telephone by 
means of a limited capacity audio response unit and through 
teletypewriter terminals. In this way WIPICS was designed 
to allow many levels of the NARFNI management to he ahle to 
follow the progress of the many processes underway in the 


plant. The managers of the six NARFNI divisions may also 
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use WIPICS to plan their workloads by determining the status 
of antecedent operations. With such capabilities it was 


anticipated that WIPICS would benefit the NARFNI by: 


1. allowing positive control of all work-in-process 
2. reducingm@turn-around time for repairs 
ey improving production rates [3, p. 912 


In the role of an information system, WIPICS would 
replace a much less responsive system known as the Uniform 
Automatic Data Processing System (UADPS). UADPS depended 
upon equipment which has rapidly become obsolete hy advances 
in computer technology. WIPICS provided a step up to a 
real-time capability for information storage and retrieval. 
UADPS was able primarily to store and accumulate historical 
Geaeanwhich was output en masse by accounting equipment. 
Seeetiic job information was difficult to ohtain and not 
timely when obtained. The UADPS summary outputs proved to 
be too far after-the-fact to provide real assistance to 
management in controlling day-to-day operations. Explanation 
of the organizational structure into which WIPICS was inserted 
was given in detail in theses by Spooner, Myers and Bradley 


Hepes, and 1]. 


pa PROBLEM ADDRESSED 

Naturally, WIPICS has associated with it costs that were 
net incurred prior to its introduction. ‘Certainly the addec 
informational capability provided a henefit in itself. How- 
ever, one could well argue that such a capability by itself 


was actually a luxury for which tax dollars need not he 


ui 





spent, and other benefits, if any, would have to he demon- 
secated. Thewinrormation, 1£ 1t did help to “positively 


control the work-in-process," should have been valuable in 
dealing with schedule bottlenecks, material shortage delays, 
and other similar work slowdowns. Hence, this positive 
control ability should have heen able to activate a quicker 
remedy at the point of concern. In looking for the answer 
Gemthe question, “Is 1t worth the cost?,” it is possible to 
consider the WIPICS impact on production time required for 
the jobs handled. If it were possible to assume that the 
workloads before and after WIPICS was installed were almost 
identical (or at least closely comparable), one might safely 
use averages of production time data to ascertain if any 
benefit had been gained. The required similarity of the 
workloads, however, was definitely not the case, and this 
forces the search for a different measure of effectiveness. 
It 1S possible to consider changes in the workload 
handled by the NARFNI and ask if there was an increase in 
the productive capability because of the greater efficiency 
and "decreased turn-around time" due to WIPICS. In order to 
ii'te= Such a comparison between the capabilities before and 
after WIPICS, there would have to have heen a high degree of 
constancy in the work force and identical job mixes across 
the compared periods. To the contrary, the work force 
suffered great variation and NARFNI faced very different job 
mixes over the time periods involved. Hence the search for 


a measurement goes on. 
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The pattern described hy the examples ahove was repeated 
often as examination was made of various ways to approach 
the basic guestion of cost effectiveness determination within 
a dynamic industrial operation. The prohlem became one of 
distilling the many internally changing situations and pushing 
forward a means of capturing before and after "snapshots" of 
the operation. Within these "Snapshots" must he some reason- 
able estimates of costs which can he compared. That distil- 
lation process 1S not unigue, as many techniques provide the 
opportunity for before and after comparison. Hopefully, 
clear-cut differences hetween performances in the two periods 
of time would be evicent no matter what procedure was used. 

In view of the inadequacy of the seemingly obvious indi- 
cators of benefit, the prohlem of how to answer the question, 
"Was the change worth the cost?," had to he attacked less 
directly. A strategy was developed to approach an answer 
by the following hroad steps: 

1. determining those models capable of representing the 
dynamic industrial situation and its cost flows 

2. collecting data needed hy the models and using the 
models to produce their intended "Snapshots" of cost informa- 
On 

3. analyzing the "Snapshots" for evidence of significant 
changes in costs 

4, analyzing the models to check the validity of their 


outputs 


di: 


A ope ee 


eet 


Be 
4 


7 


en ee 





5. comparing alternative models of the same structure 
to determine harmony of the results 
6. drawing those conclusions allowable from the models, 


their outputs, and their intercomparisons. 


eee ARGIER ANALYSES 

References 1, 3, 6, 8, and 9 represent earlier attempts 
to proceed within the framework discussed ahove. Spooner 
([6] detailed the approach procedure and indicated models that 
would be applicable to this kind of economic analysis. He 
identified the difference between the continuous and discrete 
approaches to the problem. He also noted the data elements 
readily available for analysis and indicated methods for 
handling the data. 

Bradley [1] undertook the development of methods for 
analyzing the NARF cost flow hy a continuous model which made 
use of aggregate daily statistics that were generated from 
the NARF's records of individual jobs. His work also was 
able to estimate production functions characteristic of the 
time period Meraie WIPICS was in use. 

‘Myers [3] developed a linear programming approach to the 
analysis of the NARF cost flow. His model made use of data 
on each particular kind of job and its use of constrained 
resources. His work also produced an estimate of the costs 
of operation before WIPICS was in use. 

Trafton [8] extended Bradley's work and computed cost 


functions based on two continuous models. His work developed 
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representations of the hefore WIPICS situation hased on Cobb- 
Douglas and Constant Flasticity of Suhstitution (CFS) Produc- 
tion functions. He also used data from the pre-WIPICS period 
Moecheck the validity of the resulting cost functions. 

Tye [9] investigated the validity of the Cobb-Douglas and 
CES production functions to determine their validity for 
characterizing the productive operations at NARFNI. He had 
available data from the period after WIPICS was installed 
and was ahle to make some initial comparisons between the 
before and after situations. 

The five theses mentioned above, along with this thesis, 
are related to an on-going analysis effort undertaken hy the 
Department of Operations Research and Administrative Sciences 
of the Naval Postgraduate School in conjunction withthe 
Navy's Management Systems Development Office (MSDO). MSDO 
was charged with the task of developing the methodology EOE 
evaluating the management tools in use or contemplated at the 
seven NARFs. Specifically with regard to WIPICS, MSPDO is 
charged with providing cost effectiveness information to be 
used in a decision to extend WIPICS implementation t~ other 


NARI's. 


Pree lO OF THIS THESIS 

The present work is aimed at bringing together a number 
of comparisons that have been started in earlier works. The 
linear programming model will be used to portray the after- 
WIPICS situation and compare it to Myers'results. Another 


continuous model will be introduced and evaluated. It will 


i> 





be used to provide its own comparison of the hefore and after 
WIPICS periods. The results of Bradley, Trafton and Tye will 
be summarized and their comparisons highlighted. Then various 
models will be exercised, using common sets of data, to test 
the degree of harmony among the mocels. The collective 
results of these measuring tools will then be used to draw 
conclusions about the ability to perform cost-effectiveness 


evaluations in this kind of environment. 
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Ti. SITUATIONAL COMPARISON 


As noted in Chapter I, a naive comparison of obvious 
performance factors was guilty of grave oversight hecause of 
changing conditions at NARFNI. This chapter will set forth 
some of the more important elements that underwent change as 


seen in comparing the before and after situations. 


A. METHODS OF DATA COLLFCTION 

The first change and the one for which the analysis is 
undertaken, concerns the manner in which operational data 
was collected. This is, of course, the heart of the WIPICS 
Migvathean., Prior to WiPICS,;@amformation concerning the 
status of individual jobs undergoing processing in a given 
department was collected by hand-written record in departmen- 
tal logs and required reports. Other status information of 
possible value was often collected in supervisory personnel 
memories. By adding the UADPS capability, the scribea 
reports were forwarded to centralized locations for record 
oe updating and storage and for collective reproduction by 
unit record equipment. Myers [3, p. 11] provides a compara- 
tive description of UADPS and WIPICS which indicates the 
relatively slow and cumbersome nature of the UADPS. 

WIPICS was then introduced into the shop operations to 
improve both the reporting and the record keeping functions. 
WIPICS provided the capability of direct access hy the 


operating units to the status files of jobs in their domains. 
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The status updating was done instantaneously by shop personnel 
sending progress information from push-button telephones 
directly to the electronically maintained files. These same 
files can be queried by supervisors, departmental and divi- 
Sional managers, and staff members to obtain specific reports 
about individual jobs, departmental workloads and interdepen- 
dent operations. Further details and specific operating 
descriptions about WIPICS are found in Bradley [l, p. 22-26] 
and Spooner [6, p. 11-19]. In essence, then, the change was 
one of speed and availability of the information, as Myers' 
feeepe bil chart points out. This change constituted the 


basic impetus of the analysis effort. 


Boe VODIFICATION OF DATA ELEMENTS 

Bas#c EONthe financial and Managerial accounting, crrome 
at any industrial site is the classification of the productive 
inputs as to directness/indirectness of applicability to the 
product. Both labor and material usage contain direct and 
indirect elements. At NARF, material usage can be considered 
primarily direct because of the nature of both the material 
and the work to be accomplished. Determination of the number 
Seedeeect: Mankeurs is, on the other hand, subject to constant 
reinterpretation. 

The number of manhours expended (or budgeted) is often 
central to evaluative and planning efforts, especially in 
the governmental arena. Manhours directly attributable to 
the product are characteristically prime examples of the 


"variable" input. Hence the effort is expended to separate 
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the labor time and expenditures into the direct and indirect 
categories. Such separations change from time to time bv 
management policies as new interpretations are made of the 
"directness" of given labor categories. Most of these cate- 
gories retain their direct/indirect label over time without 
Switching, but others vacillate over time as a result of 
differing judgemental factors applied and differing repair 
program emphases. In addition to policy changes, labor time 
and spending are subject to some clerical reinterpretation 
and error of classification. If the policy and clerical 
reclassification of labor were extensive, there would be 
considerable scepticism as to the reliability of direct labor 
data for measuring productive effort. Fortunately, the 
direct manhour determinations which are stable account for 
nearly all the direct labor on a percentage basis. Thus the 
peripheral areas which might change classification are 
insignificant in their impact on variahle labor input infor- 
Mation. Therefore, unless more extreme fluctuations occur, 
this source of change should not affect the WIPICS question. 


(For cost accounting procedures at NARFNI, see Ref. 4.) 


Gee CcuANGEo IN SUBPROGRAM MIX - AIRCRAFT 

As indicated in the introduction, the workload of NARFNI 
changed in character over the time periods under scrutiny. 
The aircraft program reflected this change in that the mix of 
subprograms before WIPICS was not the same as that after 
WIPICS. Myers [3, p. 17] identifies twenty different aircraft 


upon which NARFNI performs eight different kinds of rework. 


1S, 





In neither the hefore or after case were all 160 of the 
possible combinations encountered. Using this hackground, 
the before and after WIPICS workload can he compared as 
shown in Tahle I. As indicated there, 20 combinations are 
common to both periods. These twenty common combinations 
will be used in a number of the comparisons of succeeding 
chapters. It is worthy of note that approximately 70% of the 
total aircraft activity is associated with the common com- 
binations in each period. The after WIPICS period data did 
not include any aircraft of four models which were treated 
before WIPICS. No new aircraft models were introduced after 
WIPICS, however. 

Similarly, the type of work performed changed in terms of 
relative importance over the periods. This can he seen in 
the shift to different work types for a given aircraft. 
Another factor which is not explicit is the reworking of air- 
craft for which the normal lifetime has been extended. 
Instead of purchasing new aircraft as had heen planned, older 
models have meen reconditioned and returned to service. 
Naturally, the older aircraft often required more extensive 
repair and Progressive Aircraft Rework (PAR). Hence, as 
aircraft in the after WIPICS period were generally older, 
the effort required for their rework increased. 

Further classification of work types had been envisioned 
by Myers as he included a provision for recording the PAR 


cycle number of a job. This would have indicated how many 
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times the aircraft had undergone "treatment" at the NARF. 
This would have provided a means of distinguishing between 
older and younger aircraft undergoing a given type of rework. 
However, due to the complexity of tracing this information 
it was not available for the after-WIPICS period. Conse- 
quently, data of the earlier period have been reclassified 
to ignore the cycle information. The number of required 
manhours (NORM) will reflect such aircraft age differences, 
Since the NORM of an older aircraft can be expected to be 
larger. Though the cycle information is lacking, the NORM 


data should provide compensating coverage. 


ia ENGINE PROGRAM 

The engine program, second of the major NARF programs, 
was not included in WIPICS in the present implementation. 
Because of its exclusion from WIPICS, it might be possible 
to draw inferences about activity level and subprogram mix 
influences on overall plant activities. The engine program 
underwent changes in subprogram mix similar to the aircraft 
program. Myers [3, p. 16] also codes the engine and work 
types, accumulating 26 and 5 possibilities, respectively. 
Comparative tabulation is not included for the engine program 
Since it will not be directly involved in the before and 
after WIPICS comparisons. 

The exclusion of the engine program does raise a number 
of questions about the WIPICS impact. Some of these are: 

ie “Awe there Gaps an WEPICS aircralt program coverage 


due to engine program exclusion? 


Ze 





2. Does the exclusion hamper WIPICS scheduling cpaability? 
3. Can WIPICS be extended by anology to the engine 


program? 


Though these questions will not be addressed directly, they 
provide another avenue for investigation. The aircraft 
program examination, however, can treat these questions as 


independent. 
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IIIf. ALTERNATIVE MODEL FORMULATIONS 


In order to deal with the situational changes discussed 
in the last chapter, a number of alternative models have been 
developed to portray the economic interactions of NARFNI. 
Each of the models approached the problem of typifying the 
operational characteristics from a slightly different perspec- 
tive. Nonetheless, each drew certain key information from a 
common data base. This data base was taken from financial 
records of individual rework jobs published quarterly hy each 
of the NARFsunder the title, Production Performance Report 
(PPR). The models and their essential variable components 


are discussed in this chapter. 


A. VARIABLES: DEFINITION AND CHOICE 

Each of the mathematical models presented relies on 
different subsets of the information conveyed by the follow- 
ing variables: 

1. NORM - (Number of Required Manhours) 

Tits 1s determined a priori by negotiation between 
the NARF and the Navy as an estimate of the amount of direct 
labor input that will be required to perform a given rework 
operation on a given type of aircraft, engine, or component. 
This variable is often included in order to provide a hefore- 
the-fact weighting of jobs of different models and rework 
categories. To a limited degree it provides an "index of 


dureteculiy “to “characterrze the LEewOrkK™= yoo. 
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2. DMHR (Direct Manhours) 

This data element is the number of direct labor hours 
Siar ged against agparnticular jobsonder. This a posteriori 
measure is the accumulated labor time directly associated 
with productive jobs. The usual accounting conventions are 
employed in determination of this factor, subject to the 
insignificant fluctuations noted previously. 

3. DLBS (Direct Labor Expenditures) 

This factor is the actual dollar amount expended for 
input direct labor services. As such it includes both time 
and wage rate effects. A wide variety of skills and exper- 
ience levels at the NARF can be combined in many different 
ways to accomplish required jobs. This item prices out the 
DMHR at the rate earned by each of a wide variety of skilled 
workers. Thus it responds to changes in the particular mix 
of skills used on each job. Experience levels are similarly 
reflected in this composite measure, and it is in this area 


that changes in personnel ceilings become noticeable. 


DLBS 


4. P. (Price of Laboyn = SMR 


L 
This rate is the effective wage rate for a given job 
Or aggregation of jobs. This quotient can he used to compare 
distinct jobs or distinct aggregations of jobs on the basis 
of labor intensity. This factor also responds to the kind 
of labor force mix fluctuations noted above. For example, 
whenever a reduction of the work force occurs, those most 
often affected are the lower paid. Then, although a compar- 


able number of DMHR will probably be expended for a given 


a5 


a 





m@e;7) they will =be paid for at the higher rate of the remaining, 
more experienced workers. 
5. DMLS (Material Fxpenditures) 

This measure is the total cost of all direct materials 
used for a given job, priced on the basis of individual item 
costs. Adding the detailed complexity of item enumeration 
would be excessively superfluous, since there is such a wide 
variety of materials used and they are not comparable from 
foo, EO JOb or Lrom one time period to another. 

6. DOHS (Overhead Expenditures) 

This amount is defined in the usual accounting sense 
and is applied to each job on the basis of the number of 
expended direct manhours. It includes roughly all other 
expenses of operating the NARF that would be paid from the 
NIF. This factor would be affected by overall workload 
changes. Any fixed operating costs would tend to keep this 
item high during periods of lower production while they would 


be spread thinner at higher levels of production. 


7. NDAYS (Number of Calendar Days that Equipment 
Remains at NARFNT) 


By implication this measures the number of davs the 
equipment is not available for operational committment because 
See peing in rework. It is also directly proportional to the 
actual number of work days required to complete the job. As 
the latter, it would reflect such conditions as material 
shortages, increased efficiency, abnormal congestion, and 


job complexity. 
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Bi P, (Penalty Cost) 


This price represents the daily cost of not having 
a given piece of equipment operationally available. The 
product of this factor and NDAYS represents the "pipeline" 
cost associated with having a given aircraft or component 
in the rework system. 

9. NIS (Number of Jobs) 

This integer valued variable is the number of actual 
jobs in process in a given major program (aircraft, engines, 
etc.) on a given day. It was gained from knowledge of the 
following data items: 

a. IND - Induction date 

b. PD - Production date 
These are, as their names suggest, the dates on which the 
feecmdrt, engine, O64 Component entered and departed the NARF, 
respectively. A job was accumulated on a given date if that 
date fell on or between the IND and PD. 

The variables described above are those found to be most 
useful in analyzing NAREPNGSactavyity. In his thesis pespooner 
[6] described several methods for characterizing the relation- 
ships among these variables which would be of value in the 
analysis effort. Though he did not employ the methods, two 
of his contemporaries and two successors did use the methods 
he indicated and extensions of those methods. The remaining 
sections of this chapter will present the models that were 
developed and a discussion of each. The particular variables 


selected from among the foregoing take on, in addition to 


2d 





their denotative definition, special surrogate roles depending 


on the way they are handled in each model. 


Pee OALTLY PRODUCTION MODEL 
if Formulation 

In his work to develop a model of NARFNI production, 
Bradley [1] chose to consider a depiction of the daily output 
of aircraft and engines expressed in terms of NORM. He used 
the job oriented data from the Production Performance Reports 
to develop a daily flow of DMHR, DLBS, DMLS, and NIS by means 
of aggregation routines. With these variables he constructed 


mats Cobb-Douglas production function [1, p. 54] 


APH = A(APL)® (app)® (apm)Y (nrs)° 


Where 


APH = aggregation of prorated NORM over all jobs in 
process on a given day 


A = constant multiplier 


APL = aggregation of a prorated DMHR over all jobs 
in process on a given day 


APD = aggregation of prorated DLB$ over all jobs in 
process on a given day 


APM = aggregation of prorated DMLS over all jobs in 
process on a given day 


NIS (as detined In section A) 


2. Assumptions 


As a basis for this particular attack, Bradley assumed 
that NORM represented a utility both to the customer and 
NARFNI [1, p. 42-32]. He used that utility to express the 


otherwise diverse output of the NARFNI in NORM as a common 
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term. Hence, the daily output on a particular job was con- 
Sidered to be the completion of a certain percentage of that 
job's NORM. The sum over all jobs in the program then was 
taken as a measure of a day's output. 

Having decided upon this output measure, Bradley 
chose the inputs for their contribution to the productive 
process. The measure of direct manhours was included to 
account for the “physical units of labor consumed." The 
total direct labor cost was also absorbed to add the impact 
of the varying skill levels. "It was considered that both 
total manhours expended and some consideration of the value 
of manhours expended would have separate effects on produc- 
tion" [1, p. 45). DMLS was added to reflect the requirements 
of material usage on production. The aggregation process 
assumed that the expenditures of manhours (with associated 
labor dollars) and materials and consequent production of 
NORM flowed in an even daily pattern for a given job. This 
abstraction was used in lieu of a more realistic, but non- 
available, job production flow pattern. Aggregation techniques 
proceeded under the additional assumption that work continues 
seven days per week beginning on the induction date through 
but not including the production date. This assumption, while 
clearly not correct, merely has the effect of reducing the 
work on any given day by a proportionality factomem Thesvari— 
able NIS was included to account for the work flow present 
in the system at the time. It also was used to portray shop 
congestion effects. Its definition illustrates its own form 


of daily aggregation. 
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3. Procedures 

Data concerning activities of a time period under 
scrutiny were input to the prorate program described by 
Spooner [6, App. B]. Output consisted of the aggregated 
values required by the model, representing summaries of day- 
by-day operations in each of the three major programs - 
aircraft, engines, and component repair. 

In order to estimate the exponents of the three Cobb- 
Douglas production functions, a logarithmic transformation was 


performed on the basic model. This rendered: 
QnAPH = LnA + ALNAPL + BRNAPD + yRnAPM + SL€nNIS 


This transformation produced a form which was linear in the 
coefficients, and this form was appropriate for handling by 
regression analysis. Bradley chose the Biomedical Stepwise 
Regression Program to perform the analyses [l, p. 55]. The 
program computed the estimates of the coefficients, associated 
standard errors, and other values of regression test 
Seatistics. 

4. Role of Model in Cost-effectiveness Analysis 

Bradley anticipated being able to capture in the pro- 

duction function a picture of the manner in which the NARF 
teriizea 1ts resources. By comparing £Unction characteristic 
of the before WIPICS period with another function determined 
similarly for the after WIPICS period, conclusions might be 
drawn about the effect of WIPICS in improving the productive 


effort. There exists the possibility of one of the three 
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situations depicted for illustration by a two-input function 
in Figures 1 and 2. These illustrations show iso-output 
Paeeauction functions of two inputs. 

Should the results be as suggested by either case 
in Figure 1, a clear cut distinction between the two periods 
would be possible and would lead to a definite statement as 
to the worth of WIPICS. Results of the type suggested by 
Figure 2 are more likely and would cause doubt as to real 
distinction between the periods especially if input combina- 


mmens On both sides of the intersection (Zz ) were 


je eae 
a a 


feasible. Statements about the worth of WIPICS would have 
to be qualified by limiting the ranges of the inputs, and 
such statements would have to be tentative. 

Bradley's work was preliminary to establishing cost 
functions characteristic of the operations at NARFNI. The 
three production functions portrayed by him were intended for 
use as constraints for the problem of cost minimization. 


That usage was developed by two subsequent theses. 


Gere DAILY COST MODEL 
1, Formulation 
Spooner indicated in his analysis methodology that 
the developed production function needed to be used to deter- 
Mine a cost function characteristic of each time period in 
question. Trafton and Tye [8, 93] undertook this effort and 
extended Bradley's work. They viewed NARFNI as operating to 


minimize costs subject to the developed production function. 


eal 
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Hence they looked at two versions of that minimization 


problem. 
Cyan. C= PS - APL + APM + AP, 
S.t.: APH = A(APL)”~ (APM) Y (NIs) ® 
(2) Min C'= Po eee, ly st APL 
-0 = =O/) 
s.t. : APH = y[6 (APL) eae qn Seles 


where AP, is the aggregated penalty cost over all jobs in 
shop. 

The first version was built on the results of Bradley's 
work which showed the variable APD to be insignificant in 
explaining NORM. (Actual results on which this was based are 
given in Chapter IV.) The second version was developed from 
the more general Constant Elasticity of Substitution (CES) 
Puacuction function, introduced into the analysis stream by 
Trafton. Both of these versions included cost contributions 
from both "operational" and “pipeline" sources. Thus both 
the actual NARFNI.costs and a cost to the supply system/fleet 
for the awaited product have been considered. 

The form of the minimization suggested the use of the 
Lagrange multiplier technique, per Spooner [6, p. 29]. After 
forming the Lagrangian function, determining the gradient, 
setting the gradient equal to zero, and solving for cost in 
terms of the inputs (for derivation see Trafton, ref. 8, 

p. 16-21), the respective cost functions of the two versions 


were determined to be, after Jogarithmic transformation: 
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The data required to support work on these models 
consisted of the performance data that served as input to 
Bradley's procedures plus the lists of penalty costs developed 
bye Myers tor the linear programming approach [3, p. 39, 40}. 
Each penalty cost was based on the "average flyaway unit 
procurement cost" obtained from NAVAIRSYSCOM De poreeere nee Was 
fel. The procurement cost for each type of aircraft was pro- 
rated evenly over its expected lifetime in days. Each engine 
procurement cost was spread over a ten year lifetime. Because 
of a lack of detail in the data for the component program, 
Trafton and Tye restricted their work to the aircraft and 
engine programs. 

The dependent variables used for the two versions 
differed due to the independent variables chosen for each. 


For the Cobb-Douglas version, 
C = APD + APM + APS 


ime CES Version used the definition; 
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Cis ALDTAPO APS 


where APO was the aggregation of prorated DOHS (overhead) 
over all jobs in process on a given day, and AP, was the 
aggregation of the penalty costs over all jobs in process 
on a given day. 
2. Assumptions 

Building on Bradley's foundation, Trafton and Tye 
included his assumptions in the development of the models 
they discussed. Basic to their advancement beyond Bradley's 
work was the assumption that NARFNI indeed sought to minimize 
costs subject to the production function constraint. That 
is, 1t was assumed that NARFNI tried to minimize the daily 
costs of performing required daily production, expressed 
in terms of NORM. This minimization was assumed to be 
imperfectly accomplished, which gave rise to the error term. 
The error terms e€ and ¢e«', were assumed to be normally 
distributed with mean zero and constant (but distinct) 
variances. Hence, the minimization would be assumed to be 
accomplished with respect to standard costs which are implicit 
and probably not definable (beyond NORM and its compensated 
rate). This allows both positive and negative cost variance 
(in the accounting sense), corresponding to super-efficiency 
and waste, respectively. 

Another assumption stemmed een construction of the 
penalty costs. Here the basis for this pipeline surrogate 
was assumed to be the capitalized cost of the respective 


system. This would seem to be a minimum value to use, and 
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the straight line amortization probably had more validity 
than accelerated or usage-based rates which would have been 
hard to justify and determine. 
3. Procedure 

Both Trafton and Tye made use of the proration program, 
Hegditledeby Tratton to include a daily proration of the 
penalty costs based on the type of equipment involved. This 
computer program produced from the job data cards another set 
of data cards representing the day-by-day dollar and manhour 
expenditures in the appropriate categories [8, App. D and E]. 
From the prorated data, a cost function based on the Cobb- 
Douglas production function was identified for the engine pro- 
gram and another for the aircraft program. 

In order to attack the CES formulation, a two stage 
technique was used. First the least-squares estimation of 


the following relation was performed: 


Qn(NIS/APL) = a + bkn (AP_/P, ) + ¢" 


where 
Pes 
a) (ae oe 
Se gaa 
= o+1 


The resulting estimate of NIS/APL was then substituted into 
version (2) for the variable D [9, p. 21]. The second stage 
regression was then run on the resulting relation of ver- 


Sion (2). 
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Trafton dealt only with before WIPICS data and esti- 
mated relations for the Cobb-Douglas and CES cost function 
for that period only. He validated the resulting model 
using nine separate 30 day periods to compute actual versus 
predicted values of total costs. 

Tye investigated the stability of the two models 
he had estimated from a slightly updated before WIPICS raw 
data set. Then he proceeded to estimate Cobb-Douglas and 
CES cost functions for engines and aircraft for the period 
after WIPICS was in use. Prediction intervals were calcu- 
lated for each of the cost functions. Then prediced cost 
differentials between the periods were computed based on the 
models. 

4. Role of the Models in Cost~effectiveness Analysis 

With Tye's results, another step toward definitive 
conclusion was completed. The comparison of before and after 
WIPICS situations was the long desired goal. The cost func- 
tions developed by Trafton and Tye provided a basis for such 
a comparison. Exercising the model for prediction gave 
imeircation of what typical workloads would cost in each 
program in each time period. 

Tye also pointed out some of the reservations which 
must accompany any statements that are conclusions to be 
drawn from the comparisons of the models. He noted some of 
the externalities which were not handled by the models. 

Thus he pointed out the need for independent validation of 
the results. Such validation is the role of the models to 


Below. 
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Dees GINEAR ECONOMIC MODEL 
i Fornu@ation 
As Bradley was developing the Cobb-Douglas production 
function, Myers [3] prepared a linear economic model, as 
suggested by Spooner's methodology, to be used for validation 
of the continuous model results. In essence, this linear 


programming approach seeks the solution to the problem: 


Minimize Cost = actual dollar cost of resources used to 
accomplish Z (a vector of job NORMS) + 
the corresponding penalty costs for the 
Jobs represented by 2 

Subject to: accomplishing a given total NORM level and 
remaining within Set resource constraints 
With eis 2... 

This represents a verbal discussion of the model for which 
Myers provides extensive mathematical detail [3, p. 27-29]. 
Separate models were again formulated for engines and aircraft. 
Data used in this model was not prorated by day, but 
was treated according to equipment type and work type. Codes 
were assigned for each distinct engine and aircraft model and 
for each type of rework undertaken on them. (The lists of 
@gdesswere given as Tables I and Ii, p. 16, 17 of Myers” 
thesis.) Production activities were identified from the raw 
data, and a technology matrix was developed. Penalty costs, 
as discussed earlier, were introduced in this model. Myers 
emphasized that the model was not intended as a production 
Management tool but, rather, provided only budget and penalty 


cost information. He did point out the possible usefulness 


Seetraceotrt information that does result 13, ¢. 30). 
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2. Assumptions 


Myers listed four assumptions concerning the linear 
economic model: 
1) The estimated processes (reworking of engine and air- 


craft) are linear functions and therefore these 
processes exhibit constant returns to scale. 


2) The above linear processes may be estimated by the 
aggregation of a finite set of observations over 
some time period. 


ey ine NARF as not a profit maximizing organization, 
therefore the management objective cf the NARF will 
be assumed to be minimization of costs subject to 
completion of all work demanded by the operational 
forces of the Navy. 


4) Prices used in the model are constant and may be 
estimated from the production data furnished by the 
NARHee@ S35. oe cos 7 | 

fie additional assumption concerning the penalty costs noted 
earlier was applicable here. 
3. Procedures 

For the engine program, Myers used cluster analysis 
to determine the alternative processes available to the NARF 
to accomplish various kinds of work. A series of four compu- 
ter routines were used to develop distinct relationships that 
could be identified as "processes" [3, App. B-F]. These 
procedures examine vectors of input and output measures to 
determine any similarity among them. Here the notion of 
Similarity was defined in terms of having approximately the 
same proportion of input resource usage for unit output. The 
clustering programs confirmed the uniqueness of the engine 
type/work type combination as processes. 

The engine data was then further sorted by calendar 


quarter in which the work was done. Where possible, 
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additional processes were identified by quarter within the 
work type. Dominance relationships were Sought among the 
centroids of the processes. A program developed for that 
purpose was applied repeatedly until all dominance was 
removed among groups having the same output (see Ref. 3, 

meee G). This Te ae been accomplished, all the remaining 
observations were averaged to form the estimated process 
vector which related the output, NORM, to the input variables, 
DMHR, DMLS, "‘DOHS* and NDAYS. 

Because of the considerably smaller number of air- 
craft data observations available it was decided to use the 
aircraft type/work types as the processes and use all data 
within those groupings. This resulted ina linear program 
that had only one choice among the processes to accomplish 
a particular output. Hence the linear program solution was 
trivial from the point of view of choosing alternative pro- 
duction plans. It does, however, provide a meaningful rela- 
tion between workload and costs. 

After the process determination was complete, the 
chosen processes were input into another program which 
prepared as output data cards in the proper format for the 
Mathematical Programming System/360 (MPS/360) linear program- 
ming (simplex) routine [3, App. K]). Also included in the 
input to the preparatory program were the penalty costs which 


Myers had computed, the production requirements, the resource 


Ioue to a systematic error, these costs were determined to 
be incorrectly calculated. Corrected factors are listed in 
Ghapter IV, Section F, of this thesis. 
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constraints, and an average labor rate. The output of the 
preparatory program was then input to the MPS/360 program for 
Souution. 

eee sOrecrot themModel in Cost-eftfectiveness Analysis 

As stated earlier, it had been hoped that the linear 
economic model would have been able to provide validation for 
the results of the continuous models. Myers did expect any 
measurable decreases in input usage per unit of output to be 
evidence of an improved situation after the WIPICS installa- 
tion, or the contrary. The changes could then be associated 
with a dollar value to determine savings or cost growth. 

As only the aircraft program turned out to be of 
interest, the measures provided by the linear model would 
only be of the grossest variety due to the data limitations. 
The linear model solution provided the total cost computation 
and estimates of the process in the format of inputs per 
unit output. The total cost can be compared for the before 
and after WIPICS situations. Processes with the same output 
can also be compared for the two periods. Further validation 
can be sought from continuous analogs of the linear model, 


which follow immediately. 


E. JOB COST MODEL 

The derivation of the Daily Cost Model's relationship 
between cost and input factors highlighted some of the inde- 
pendent variables used in the present model. The formulation 


and development of the Linear Economic Model emphasized the 
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differences between the subprograms and the need to allow 
for those differences. A means for hlending these important 
considerations into a continuous relationship was provided 
in the current model. 
if formulation 

Although the Cobb-Douglas production function form 
would usually he applied to physical outputs in terms of 
physical inputs, one could approach cost flow itself, 
@mepriOri, as the product of input cost determinants in a 
Similar functional form. This model considered tne output 
to be the cost flow from a given aircraft type and work 
type combination. An alternate derivation of the relation- 
ship is provided in reference 2. Couched in terms of the 


Original variables, two versions were constructed: 


B B B B 
(1) c. =a.(P. ) (ep ) 7 (HTS) 2 (NoRM ) 7 
1 a a 
8 6: B 8 , 
(2) Cc, = al(P, ) *(mpays ) “(NTS ) (norm) * 
where i = 1,2,...n = number of aircraft type/work type 
combination 
NIS = average number of aircraft johs in shop over 


the period when jobs in category 1 were under- 
going rework 


Thus n different functionsof each version are proposed: 
each with its unique constant hut holding a common relation- 
ship among the explanatory variahles. In a hybrid of matrix 
and standard notation, the n equations can be comhined for 


each version in a Single function: 
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bh. = 7 2. Oe 
P+ —~— Ty 


B B B B 
(1) C = (AV,)(P_) ~(PD) “(NIS) * (norm) * 
By BF ex *3 8 
(2) C = (Atw.) (P,) (NNAYS) (NIS) (NORM) 
where A = (7 1Gnre--O,) 
A‘ = (O15 15 7ee-O,) 
vs = column vector with zeroes for all elements 


except the i1¢®, where a 1 is placed; that 
is, the ith canonical vector. 


The model was used to explain three different forms 
of cost, analogous to the three objective functions Myers 
considered. For versions (1) and (2) the dependent variables 


chosen were: 


(a) i@ectotal cost) = DLBS + DMLS + DOHS + P,NDAYS 


(b) OC (Operations cost) = DLBS + DMLS + DOHS 


The third form was used only with version (1) due to the 


respective definitions of the versions. 


fe} PGbenalty cost) = Pl: NDAYS 


Work on both versions called for the raw data. Also 
required was determination of the number of all aircraft 
jobs in eer de on each day during the periods under consider- 
ation. Finally, a listing of daily penalty costs was neces- 
sary. Only the aircraft program was considered due to the 
exemptions of the engine program from WIPICS implementation. 

2. Assumptions 
Basic to the structure of the model was the assumption 


that cost can he treated as a product of internal influences 
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ememecan be Litsinto the mathematical framework. The internal 


influences were portrayed, first, by PL which took on the 


surrogate role of an indicator of complexity of a joh. Recal- 


DI-BS 
DMHR ° 





ling that it is defined as it was thought to respond 
well to the effect of the use of higher skilled labor on jobs 
of greater complexity. NIS, the average numher of jobs in 
the shop during the rework of a given joh, represented conges- 
tion within the plant. It would reflect the impact of the 
greater inefficiencies that result from increased congestion. 
It was assumed that the NARFNI would not be operating in so 
low a range of NIS that there were very few jobs in shop 
and plant size inefficiencies developed. NORM provided 
information concerning the sheer size of the task to he 
accomplished. 

For version (1), PND was used to account for the 
trend of costs to grow over time. Included in that growth 
would be inflationary effects in the materials and overhead 
contributions and the effects of age of the aircraft which 
would also be seen in materials and overhead increases. 
NORM would probably account for any direct manhour increases 
m@mte were the result of working On aging aircraft. For ver- 
sion (2), NDAYS would provide the alternative view of effects 
due to the amount of time an aircraft spent at NARFNI. The 
most directly affected cost would be the penalty cost, hut 
this measure would also reinforce complexity effects in the 


"Operational" costs. 
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The model, as pointed out in the previous section, 
assumed that production of costs was the result of common 
influences up to a multiplicative constant. This would be 
justified on the basis of the fact that, though many 
different subprograms are accomplished, the same departments 
and divisions of the plant are used across the subprogram 
Wee. The constant factor would tend to “price” the aircraft 
type/work type combinations according to their relative 
materials and overhead mix characteristics. Within the 
categories, the individual jobs were considered homogeneous 
enough to justify the groupings. 

By Solace the costs predicted by the model were 
not related to a particular optimization goal within the 
NARFNI. Rather these predicted costs serve as a type of 
standard cost structure for the operation. The dependent 
variable was measured in terms of actual costs and hence 


give rise to a stochastic discrepancy. Hence the two versions 


of the model were really assumed to he represented by 


a By 


' By Bo B 3 
ial.) C= (A jp) (P,) (PD) (NIS) (NORM) 10 


: p Bi 


g | 
(2) c' = (A“y)(P,) *(PD) * (NTS) (orm) * 10° 


The error terms (e€ and e€') were assumed to arise 
from deviations from the "standard cost." Such deviations 
were assumed to be the result of greater or lesser than 
standard efficiencies gained from "non-standard" skill level 
mixes. Alternatively or additionally, any difference of 


DMHR from NORM would also be a basis for the existence of 
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the error term. Finally, the assumption of the standard 

linear model were applied to the logarithmic transformation 

of the two versions above (see Thiel, ref. 7, p. 110-111). 
3. Procedures 

In order to gain information concerning the number of 
aircraft in shop, NIS, on a given day, Trafton's version 
Se the aircraft prorate program was used [8, App. D]. It was 
modified slightly to accomodate the entire three year range 
of data. All aircraft data cards were used to obtain the 
most complete historical record possible. The output deck 
included all the aggregated prorated variables in addition 
to the desired NIS. Only the last was used, however, along 
with the raw data, as input to the regression program. 

Also calculated for input to the regression program 
was a revised list of penalty costs, correcting a systematic 
error in Myers' list. The final inputs were the raw data 
cards themselves separated into before and after WIPICS 
sets. A "buffer" time period of induction dates was excluded 
to aid in the distinction between the hefore and after data 
sets. The buffer was characterized by induction date before 
WIPICS and production date AE ey 

These inputs were prepared and assembled for use 
with the regression program given as Appendix A. This 


program produced a stepwise regression, admitting each of 


2 PAE to the long time period required for aircraft rework, 
a number of the jobs included in the before WIPICS set also 
had this feature. In these cases, the majority of the produc- 
tive effort was before WIPICS. 
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the explanatory” variables in order. Inclusion of the sepa- 
rate categories was accomplished by creating a dummy variable 
for each. (Seee Une, bere) ,.es 4155-156.) Structure of the 


model for regression then became, in general: 


C= ¥b+ € 


mere ( 25 anmxi vector of the logarithms of the 
dependent variables 


X= | K Z|, is an mx (n+4) matrix of dummy variables 
and logarithms of the explanatory variables 


K is an mxn submatrix such that each row contain one 
value of 1 and the rest zeros. That non- 
zero value falls in the column corresponding 
to the aircraft type/work type category. 


mo am (n+4)x | vector of coefficients 


wD 


is an mx4 submatrix of logarithms of the explana- 
tory variables 


1S anem xi vector of disturbances 


sii), 


= number of categories 


total number of observations 


= 
fl 


Solution procedures proceed as described by Bradley 
[1, Chapter II, Section B]. The regression program also 
provides the standard statistical test values. 

Regression estimates of the parameters were accomp- 
lished for both the before and after periods. The estimated 
relations were then used to predict cost values for two test 
cases drawn from the 20 categories present in both the before 
and after periods. The process was repeated for both of the 


“Eollanatory is used here to distinguish between input 


production variables and the constants which are based on the 
categories, even though those category-related constants 
"explain," in a sense. 
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versions and for each dependent variable structure. Standard 
errors of the predicted total costs of all jobs in the test 
cases were computed as the mean square error. 
4. Role of the Model in Cost-effectiveness Analysis 

The job cost model served to provide a basis for 
validation of Tye's results. It was thus able to overcome 
some of the weakness of the linear programming formulation. 

The model also provided its own characterization of 
the NARFNI operations in terms of cost flow. As such it 
provided the possibility of another view of the before and 
after WIPICS situation. In much the same manner as the Daily 
Production Model could he used to relate before and after 
isoproduct surfaces, this model could be used to generate 
isocost surfaces. As before, dominance of one surface hy 
the other gave comparative statements a very sound hbase, 
while intersection of the surfaces introduced many reservations 
and limitations. 

The model did add to the hody of alternatives within 
which the cost-effectiveness question can be framed. Exercise 
of those alternatives in the next section unfolds that frame- 


work. 
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DVee RESULTS OF EXERCISING MODELS 


Each of the models in the previous chapter was exercised 
using data supplied by NARFNI through its Production Perfor- 
Mance Reports. General characteristics of the data base are 
presented here followed by the results of each model's usage. 
Previously reported results are presented in synopsis only. 
Though most of the models included a parallel structure for 
the engine program, only aircraft results are included in 


this chapter. 


A. DATA BASE 

A total of 837 aircraft job accounting records were 
included in the data available from the PPR. The elements 
of information were selected and transferred to computer card 
record as indicated in Appendix A of reference 6. The 
seventh field, Airframe Change Manhours, which has been 
ignored by all models was originally included on the cards 
for possible investigation. The data elements represented 
ene inducted on or after Julian date 0069 (10 Mar 70) 
Peeougy Julian date 2332 (27 Nov 72). Production dates of 
these jobs extended to Julian date 3066 (7 Mar 73). For 
reference, WIPICS was installed during November of 1971 and 


was operational in December 1971. 


Boe OGY PRODUCTION MODEL 
Bradley used data that began with an induction on 0069 


and ended with a production on 1235 to generate his aggregated 
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prorated statistics [1, App. A]. Near both the heginning 
and ending of this period, not all jobs in shop were included 
in the data available, and the regression was limited to the 
Ber10d corresponding to 0208 through 1153 during which time 
the job records were considered complete [l, p. 57]. 

Based on these derived observations of daily flow, he 


estimated the production relation to be [l, p. 77]: 


APH = (57.36) (apt) 9° 38194 (apy ~9+ 23714 pyzgy 9 - 88208 
Standard error of expoents (0.04414) (001879 ) (.04410) 
Multiple Correlation Coefficient .9610 


Collinearity of APD with NIS and APM precluded its inclusion 
mamene regression [1, p. 59 £f]. 

Bradley attempted aggregations on weekly and monthly 
bases but found no improvement over the daily hased result 
above. His work provided a basis then, for the extensions 
that followed and indicated which explanatory variables were 


most effective in NARFNI production description. 


Se DAILY COST MODEL 

Trafton used the data base selected by Bradley to imple- 
ment his penalty cost extension and develop the CFS functions. 
His work, based on the Cobb-Douglas version, produced an 
estimated relation for total daily cost (equal to the sum of 
labor, material and penalty costs) with the following speci- 


mecacion (cep. 34 |": 
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a (2.64) (APH) */°* (apL)**©?9 (ap_y7 +279 
Standard errors: 0) (.056) (7013.0) 
Multiple correlation coefficient squared, Ra = .960 


The CES cost function he introduced showed daily total 
cost (equal to the sum of direct labor, overhead and penalty 
costs) to be specified according to the following estimated 
melation (8, p. 30): 

eam @ec7 Oy (Pe APS (1/1) ) (Ae) > ee oP 
Standard errors: (.006) (.149) 


where ey 1 estimate of the relation 


I/L = a (P, /aP,)?e" 


Doe (ree 


O> 
iI 


6,p are estimated by simultaneous solution of 


a 
2 pee eel 
Se eae 
ee 
and b= p+L 
Multiple correlation coefficient, squared, Bo = .988 


By these estimated cost relations, Trafton had produced 
two methods for characterizing, in dollar terms, the cost 
flow of NARFNI production efforts before WIPICS was initiated. 
Using methods he described, a similar cost flow relationship 
could be derived for the after WIPICS period. As he 
explained, test cases could then be used to compare, in 
common dollar terms, two situations that were quite different 


if described in terms of production effort. 
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bea DATLY COST MODEL, EXTENDED 

Using observations of jobs processed after WIPICS was 
installed, Tye was able to provide a characterization of that 
period for comparison as Trafton had proposed. He also had 
available additional data for the period before WIPICS to 
complement and advance that data set. Hence he was able to 
estimate an updated version of both the Cobb-Douglas and CES 
cost functions for that period. He also had over two hundred 
observations from the after WIPICS period for comparative 
estimation for the later period. 


He estimated for the Cobb-Douglas version [9, p. 36] 


C = (A) (APH)” (APH) © (APP) Ye® 





Coefficient Estimates R? 
A 0 B Y 
Before: aa “8o7 2 3516 -.094 ~949 
Motandard error) (.011) (. OSG» (30m) 
After: Ay, ~745 22 -.487 7076 
foeandard error) (.071) Cihe234)) (.066) 


For the CES version (with a different cost composition) he 


estimated [9, pewoG 


C= BIP, + AP, (I/L) ] (APH) ® a 


a2 





Coefficient Fstimates R 
B 0 g 
Before ZO ane, ~o.06 =O AZT 5) 51/2 
(Standard error) 019) (.543) 
After Sr 50) .881 24124 oO 
(Standard error) Onn) es eh 


He reported significance of the differences in both versions 
between the before and after estimates, based on the Chow 
test. He chose periods of time close to the changeover for 
use in the regression analysis. This was done to minimize 
the instability he noted in preliminary regressions [9, Chap- 
mevaeitt and p. 35 ff). 

He then used the before and after regression estimates to 
predict costs of a sample drawn from the regression construc- 
tion data. He expressed the results as total cost differen- 
tials, that is, as before WIPICS cost minus after WIPICS 
cost, a positive value indicating a less costly after WIPICS 


Situation as shown in Table II below [9, p. 41]. 


JeVer ioe sia 


Pier Rever BETWEEN PREDICT PEVCOSTSs— hr RAMES 


C-D Cis 
Case I 17,885 35.006 
Case II OF al Fale S 


a) 





He indicated that only in the Cobb-Douglas version would the 
savings be significant with at least 90% confidence [9, p. 43]. 
It might be noted that Tye based the work on the penalty 

costs developed by Myers. Tye's work might be recomputed 
using the corrected penalty costs. Tye qualified the savings 
description with acknowledgement of fact that there were 
externalities not measured by the model which may have impor- 
tant explanatory capability. 

Tye's work thus represents the first comparative state- 
ment about the effect WIPICS may have had on the operation 
of the NARFNI. It was based on the general assumption of 
cost minimization subject to accomplishment of a given work- 
load. His findings presented one view of the cost flow of 
NARFNI and were subject to the next step of the procedure 


advanced by Spooner,validation. 


E. LINEAR ECONOMIC MODEL 

Ihe Jusye os asispblloes 

Myers used the before WIPICS data to generate a 

technology matrix characteristic of that period. He used 
Meat matrix to predict the total cost, including penalty, of 
a projected workload. He proposed that engine and aircraft 
models be checked by comparing actual costs of that workload 
after completion. This was not completed either by Myers or 
since the time he finished his work. (Myers' specific results 
Pe noOmpEeporred; = see rer. 3,ep. 41. £f for deraits.} Phe 
proposed comparison between predicted and actual costs has 
been accomplished, however, in the following extension of 


has. Work. 
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2. Extensions 
In order to make comparisons between the two periods 
of interest, adjustments had to be made concerning the air- 
craft type/work type groupings. As stated in Chapter II, 
cycle information for after-WIPICS and some later before- 
WIPICS jobs was not available. This item was not reported 
among the PPR elements. It had been gained with the earlier 
before WIPICS data only by special research effort by MSDO 
personnel, who were unable to continue due to increased 
administrative workload. As a result the second character 
of the work type in the coding scheme was ignored for all 
data. Thus, for example, F-4 aircraft undergoing PAR for 
the fourth, fifth, and sixth time would be united into one 
process instead of three separate processes as had been 
established by Myers. This action reduced the number of 
processes of the before WIPICS period from 70 to 39. Exam- 
ination was made of those individual processes which were 
grouped together, and they showed sufficient homogeneity of 
NORM that the unification did not misrepresent any one 
process. 
The 837 data cards, each representing one aircraft 

job, were separated into three groups: 

1. 414 jobs before WIPICS incorporating, extending and 
filling out Myers' base 

2. 158 jobs in a buffer period 


3 ecoeeieboeatter WIPICS 
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The buffer period consisted largely of johs started before 
and finished after WIPICS was initiated. That period 
included all jobs with induction dates between Julian dates 
1181 and 1334 inclusive. These dates were arbitrarily chosen 
to allow for the long time period required for aircraft 
processing plus the indeterminate period while WIPICS was 
being initially tested. The before and after groups were 
also used to generate the regressions used in the job cost 
model. 

The two groups were compared to determine the 20 
matching categories listed in Chapter II. Subgroupings of 
matching categories were then selected, representing 
70.4% (257/365) and 68.7% (182/265) of the original before 
and after WIPICS groups, respectively. In the interest of 


descriptive brevity, let 


{B} be the set of observations before WIPICS 


oe be the stibset sof Gbsermvativons of 1B} that 
matches the categories after WIPICS 


{A} be the set of observations after WIPICS 
re be vthe subseteot 1Aletmae matenes tine 
categories of {B, } 


Data sets {Bul {A}, and {A} were used as input 
to Myers' Average Cost of Labor program [3, App. J], produc- 
ing average labor rates of $6.20, $6.72, and $6.74. This 
Semoared tems6.17 eomeaeea for {B} by Myers. Increases in 
labor rates were noted in every process although the increases 


were not of uniform proportion among the processes. Data 


sets oe and a were aggregated using Myers' Aggregation 
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Program [3, App. F], to produce inputs for subsequent 
programs. 

Prior to use of the preparatory program, the cor- 
rected penalty costs were computed. (These are given in 
Table III, which is placed with Tables IV through X at the 
end of this section.) As suqgested by Trafton [8, p. 40], 
the activity vectors were set at the actual level of NORM 
corresponding to the jobs in the sample and are listed in 
Tables VI and VII. The labor rate, process aggregations, 
penalty costs, activity vector values, and non-contraining 
resource values were inputs to the MPS/360 Data Preparation 
Program [3, App. KJ]. This program was modified to provide 
for the set-up of three different problems corresponding 
to three different ohjective functions. These ohjective 
functions matched the variations of the Job Cost Model and 


were specified as: 


my Mam: Total Cost = [P'T., + C12 


2) Min: Operations Cost = P'T.2 


3) Min: Penalty Cost = Cnn 42 


where symbols are defined as in Myers [3, p. 27 ff.]. 
The preparatory program provided most of the specially 
formatted input for the MPS/360 linear programming routines. 


It also produced a listing of the elements of the submatrix 


T. for comparison between periods. The T, listings are 


ay 





given in Tables IV and V. The sledgehammer of the MPS/360 
routine was then used to "execute" the "gnat" of objective 
function summation. 

The construction of the technology matrix was such 
erve t T) = I, the identity matrix, for both the before and 
after situations. The T. and T matrices, however, did take 
on characteristics of the two periods. In order to use the 
models for prediction, two test cases were run against both 
the before and after models. The test cases were simply the 
two activity vectors and the two price vectors associated 
with each model. Activity and price vectors run against 
their own models simply provide actual cost determinations, 
but the runs against the opposite model represent predicted 
costs. The costs were calculated for each of the objective 
mrretion versions and the results are listed in Tables VIII, 
ime, are X. 

The tables of comparative values are of the follow- 


ing format: 


Before WIPICS Model After WIPICS Model 
NeLtua lL Weostvot Preamueted Cos tie 
{B_,} 
M Mehra 1B} 
Predreted.-Coct of Actual Cost of 
{A,,} 
M ‘ {AS 
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PV figures represent millions of dollars. The upper right 
@eumer prediction of Table VIII, for example, is read, "If 
fae jobs represented by eid had heen accomplished during the 
mamecet WIPICS period, 1t is predicted that the total cost 
would have been $51.498 million." Dollar amounts may be 
Semoared horizontally, but not verically, since the data sets 
are quite different in size and composition. 

As the comparative results indicate, the after 
WIPICS period costs were estimated to be higher in each of 
miemcost Variations used. Comparison of entries in the T., 
matrices for before and after situations emphasized the 
increases in resources used per hour of NORM. In every 
process at least one coefficient was higher for the after 
WIPICS period, with many cases showing two and three increased 
coefficients. Any decreases were relatively smaller in magni- 
tude than the increases. This model contains no inherent 
inflation compensation for the materials and overhead expen- 
ditures such as the DMHR price has. 

Comparing’ the activity vectars in Tables VI and VII 
highlighted another potential problem. The two vectors 
presented radically different levels of activity in many of 
the processes. Such differences could greatly magnify any 
deviation of the linear relation from the true relationship, 
which is more probably non-linear. Possibly the linear 
estimates were pushed too far beyond their usefulness. 

The linear model results provided a sharp contrast 


to the results of the daily cost model. Hence it did not 


ag 
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serve to validate that model. Neither did the linear model 
refute the daily cost model, but it did introduce well 

founded doubt. This nebulous situation would provide addi- 
tional cause to seek another validation method. The follow- 


ing model was developed for that use. 


TABLE Ie 
CORRECGSED PFNALTIaeOsTS 


mereratt Program 
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Type Unie Service Life Penalty Costs 

pee raf t Cost (months) (S/day in shop) 
C-2A 510,, 7427000 LOS) BAaUr es 
E-2B PO, 742,000 1:5 3410.15 
F-4B 2 56, 000 80 1148.33 
RF-4B 27699 000 96 yet) lie 
F-4J 2,492,000 80 1 OFeie eyes 
RF-8G 7 300;,000 75 57 wee 
F-8H lope '5 ap MONG, 54 834.48 
F-87 W502 1000 54 803.62 
RF-3A i Slay 00 80 628.27 
SH-3A i 27 OO Oe 80 So2e a5 
SH oD) 1,064,000 80 fase 
CH-46A 1, 0827000 80 Alec 0 
UH-46A 834,000 80 Ban a7 
CH-46D 1,016 2.0 80 80 AS i220 
UH-46D 834,000 80 347.47 
CH-46F 1,083,008 80 451.20 
CH-53A 11,4535 000 96 504.46 
CH-53D 1, 4537000 96 504.46 
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Base 
Cases 


{B,J 


1 Seas 


Base 
Cases 


{B,} 


{A,,} 


TAB i it 


LINEAR MODEL RESULTS - TOTAL COST 


Before WIPICS Model 


After WIPICS Model 





(hitiions. of. “dedebars } 


TABLE IX 


bENEARYMODEL RESUBTSe— OP bReamlONSs geo. 


Before WIPICS Model After WIPICS Model 





(millions of dollars) 


TABLE X 


LINEAR MODEL RESULTS -SkENAD TE weosT 


Before WIPICS After WIPICS 





(millions of dollars) 
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fae OB. COST MODEL 
Po Ee markat lon 

Trafton's proration program was modified to accommo- 
date a time span of 1100 days and was used to produce a card 
meecord that included NIS data. The complete set of 837 data 
cards was used to provide as complete a record as possible 
of the variable NIS. The usual "tails" appeared and decision 
was made to define the usable period as that period between 
miemfirst and last occurrence of 60 jobs in shop. This 
provided cutoff dates of 0187 and 2272 respectively. For 
the regressions, any jobs falling outside of that interval 
were ignored. Data sets {B} and {A} were assembled as 
described previously to be used for the regressions. The 
corrected penalty costs were used in this model, as listed 
in Table III. These inputs were then run with the regression 
program given in Appendix A. The program provided simul- 
taneous regression and prediction results, hut these have 
been separated in what follows for the purposes of discussion. 

2. Regression 

The program used for regression analysis calculated 
the estimates using logarithms of base 10. The program 
established dummy variables for each different category 
encountered. In the models based on the before WIPICS situa- 
tion 36 dummy variables were generated compared to 37 for the 
Perer WEPmCS situetion. As noted insChapeer li, tnere were 
20 categories common to the two periods and all twenty 


entered the regression base. The possibility existed that a 
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the variation in their dependent variables. The standard 
errors of the dependent variables were also consistently 
low which indicated that the functions provided a good fit 
fee the actual data. 

Between the two versions on the comparable cost 
definitions, the estimated relationships of version 2 showed 
better measures of variation accountability and fit than did 
the counterparts in version 1, except in the after WIPICS 
operations cost functions, where there was almost parity. 
Recall the version 2 models use NDAYS in lieu of PD in the 
explanatory structure. Such was not unexpected since the 
duration of time spent in rework would be more likely to 
explain cost than a trend - ceteris paribus, as they were in 
this comparison. 

Another measure of model accuracy included in the 
tables is analogous to what Tye referred to as “percent 
error in cost" [9, p. 29]. This measure is the standard 


error to mean ratio (SF/M) and is defined: 





SE/M 


il 
5 
| 
: 
}- 
bes: 
= 


where ee =Norectcted Cost Of Jer a. 


The models of Penalty Cost separated out this imputed 


Measure and suggested some possible explanations. In both 
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before and after WIPICS situations, the NIS variables entered 
with negative exponents as was true in the other cost varia- 
tions of version 1. Recall that Trafton and Tye reported 
Similar results for the companion AP... Rather than indicating 
purely congestive effects this variable probably portrayed 
Eee effects of job flow pressure. A job inducted and 
reworked during a period of lower density (lower MIS) was 
probably not expedited to the degree those of higher density 
times were. Hence its overall stay at NARFNI may have 
lengthened, increasing the penalty cost. The management adaae, 
"Work expands to fill the time allotted," may also apply to 
Enis particular industrial operation. 

Between the two penalty cost models there was also 
a shift of explanatory power of the variables. The before 
WIPICS model showed the influence of the trend factor PD, 
while its coefficient in the after WIPICS model is not 
Significantly different from zero. An examination of the 
sequential values of NIS, recorded by the prorate program, 
confirmed a distinct upward trend in NIS over the period 
before WIPICS was installed and a level pattern during the 
after WIPICS period. The results were then consistent; as 
the workload increased to the after WIPICS level, the PD had 
no trend to indicate and NIS reflected that the "pressures" 
had more relative impact on cost. Further, the Operations 
®ost tLunctions of version 1 show that” both betore and arker 
WIPICS estimates of the NIS coefficient are not significantly 


different from zero. Hence, from the operational viewpoint, 


NIS did not seem to reflect congestive effects, either. 
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Ime the Total Cost models of version 1, there was a 
dramatic shift in the importance of the explanatory variables. 
The before WIPICS model indicated greater diversity among 
the job categories as demonstrated by the values of the 
dummy variable coefficients. In the after WIPICS model, 
the explanatory variables took a greater role and indicated 
more commonality of the job categories as shown by smaller 
variations in the dummy coefficients. The influence of NIS 
On penalty cost contributed to its entry into this model; 
whereas NIS did not enter the before WIPICS model. 

Concerning the models of version 2, comparison of 
the Operations Cost to Total Cost showed the relative changes 
in role between NORM and NDAYS for both time periods. The 
Operations Cost was more NORM-dependent while the Total Cost 
showed the effect of adding the penalty by the increased 
relative importance there of NDAYS. The difference in the 
definitions of the alternatives provided that expected 
result. 

More dramatic and not expected was the change across 
time periods in the sign of the coefficients of NIS. While 
this happened in both Total and Operations Cost models it 
was most pronounced in the latter. In these models the 
combination of NDAYS and NIS should actually provide a 
measure of congestion. One possible explanation was con- 
sidered: If WIPICS had been effective there would be reason 
to believe that congestion would no longer influence the 


productive processes and costs generated there. The estimated 
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equation for the after WIPICS period did not include a signi- 
ficant coefficient for NDAYS, which would render NIS more 
indicative of pressure than congestion. 
Some reatect1on 
a. General 
The base cases Gere and ee used in the linear 
models were also used to predict costs in each of the 10 
models. The base cases contained observations which had only 
the elements necessary for specifying three of the four 


explanatory variables: NORM (directly), P. (DMLS/DMHR), and 


L 
PD (directly) or NDAYS (PD-IND). The appropriate value of 
NIS was generated by the program if the observation met the 
criteria used for the regression observations. However, 
those falling partly or wholly in the "tail" periods were 
assigned an NIS value equal to the overall average value 

of the complete before or after period from which they were 
taken. The average number in shop for the before WIPICS 
period, 0187 through 1364, was 87 jobs. For the after WIPICS 


4 Ths 


period of 1335 through 2272 this average was 97 jobs. 
procedure, while improper for regression, is not an undue 
extrapolation for prediction and was done to insure that all 


observations of eer and ae were included. Better compar- 


ability with the linear model was expected under such rules. 





4Dhe time period overlap was intentional. This was done 
to include the effect of those few before WIPICS jobs of 
great length that were still in process until the year end. 
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PB ii 2 
VERSTON Ll BEFORE WIPICS TOTAL COST 


sem GF CEPENDENT VARTABLE VALUES IS 0.7979D 08 

eur OF PREDICTED DEPENDENT VARIABLES IS C.7925D 08 
STANDARD ERRCR TO MEAN RATIO IS’ 0.1402D-O01 

MEAN IS 0.2254D O6& 


ANALYSIS OF VARTDANCE 


SOURCE SUM OF SQUARES OF MEAN SQUARE F STATISTIC 
S'S 0.9842D 04 Boe 0.27800 02 
RDM 0.9815D 04 1 On 9S DOr is ote eae ene SS 
Ss Q0.266€6D O02 355 O. f25e0- O02 
RDB 0.9841D 04 40 0.2460) 03 i ee 
RDBA O.2599) 02 29 0.6663D QO 309.2449 
ERRCR 0.6765D 00 314 0.2154D-02 


RSCR IS 0.97460 00 RSOR ADJUSTED 15 O02 3773) 00 
THE STANDARD ERROR OF THE DEPENDENT VARIABLE 1S 0.46420-01 


VeerABLE COEFFICIENT SD) ERRGR T STATRSC 
L QO.1326D 00 0.7646D-01 Oe aD 01 
Z C€.2003D Q0 Ona bis UL 0.63520 70) 
5 —O~w3%725D O00 0.53950 0G =-O. Tr bau 
4 0.3557D QO Os 22560>01 Os Layer 02 


@retables XI through XX, asterisks indicate an F statistic 


value greater than 100,000. 
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TABLF XII 
VERSION 1 AFTER WIPICS TOTAL COST 


Semele DEPENGENT VARTABLE VALUES IS 0.45160 08 

Buin UF PREDICTED DEPENDENT VARIABLES 18 C.45040 08 
STANDARD ERRGCR TO MEAN RATIO I[S 0.1415D-01 

MeeN 1S 0O.2240D O0€ 


ANALYSIS Ge VARIBAL GE 


SOURCE SUM OF SQUARES DF MEAN SQUARE F STATISTIC 
TSS 0.5431D 04 193 O-2enpe oz 
RDM 0.5420D 04 l 0-5420D 04 eek ek a bk 
TSSA 0.11250 C2 192 0.5859D-01 
RDB 0.5431D 04 41 0.1325D 03 98676.8894 
RDOBA ~1105D C2 40  0.2761D 00. 205.6578 
ERROR 0.204CD 00 152 0.1342D-02 


RSGER IS 0.98190 00 RS@R ADJUSTED 1S 90.9778 00 
fine STANDARD ERROR OF THE DEPENDENT VARIABLE JS 0.36640 —01 


Veereaspie COEFFICIENT STD ERROR T STATISTIC 
L Oi 2 Ole OO On ST77D=Ol Orrrercis Ome 
e C.2804D OC O0.1614D QO Ont Sane nO) 
5 Ceo go OO Ox 25210 OC. =z ara. 
4 0.8653C QO 0.692320-01 C.1248D O02 
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swr GF DEPENDENT VARTABLE VALUES IS 
plume OF PREDICTED DEPENDENT VARIABLES IS 


MERSTON 1 SBEFORE WIPTEGS 


TABLF XIII 


STANDARO ERRCR TO MEAN RATIO IS 
MEAN IS 0.213250 06 


ANALYSTS OF VARIANCE 


BENS COST 


0.46895D 08 
0.4659D 08 
O.12495D-O1 


SUURCE SUM OF SQUARES OF MEAN SQUARE F STATISTIC 
Toes QO.909SD 04 354 0.2570D 02 
ROM 0.9081D 04 l 0.90810 04 nk oe eae ee 
fio SA Gers2 (D0 O02 353 0.51 76D-01 
ROB O.9098D 04 40 Oneal. 5D O32 SE 728.8696 
RDBA Sab aon 02 39 0.4499D 00 195.2932 
ERROR 0.72340 CO 314 0.2304D-02 
eScR IS 0.96040 00 RSQR ADJUSTED [S$ 0.95550 00 
THE STANDARD ERROR OF THE DEPENDENT VARIABLE IS 0-4800D-01 


MoRMABLE CCEFFICIENT STO ERROR Te@eTATisaiic 
L 0.2345D O00 0.7/907D~OlL Oe2e col <0] 
2 0.17430 90 Oe 532500201 Q0.5350D Ol 
5 Wels 200) 00 O.351CD OQ ~-C€.44C3D 00 
4 8529190 00 Gee 5550-01 O0.1680D OQ2 
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TABLF XIV 
MERol GN ATER WEP) CS OP NSae CST 


poMmeoGF DEPENDENT VARIABLE VALUES IS 0.2752) 08 

SUM CF PREDICTED DEPENDENT VARIABLES IS 0.2744D 08 
STANDARD ERROR TO MEAN RATIO IS O.1146D-01 

MEAN IS 0.1426D O6€ 


ANALYSIS QF VARIANCE 


SOURCE SUM OF SQUAKES OG MEAN SQUARE F STATISTIC 
TSS 0.5050D 04 [3s Oe Ole D107 
ROM 0.5043D 04 Ie 0.5043D 04 ake ste he oe ott ak ok oh ok ok 
TSSA Oe O10 | L132 0.3754D-01 
RDB 0.5050D 04 41 Onl ZS2pros 16238. 7354 
RDBA 0.6962D Ol 40 O0.1740D 00 lOns (305 
ERRCR 0.2456D CO Lo 0. beep = OZ 


RSQR IS Css6590D 00° RSQOQR ADJUSTED TS “Cx e700 ecG 
THE STANCARD ERROR OF THE DEPENDENT VARIABLE IS O.4C19D-O1 


Pere ABLE COEFFICIENT STD ERROR T STARS Cc 
l 0.-5886D 00 O22 etc 0.1036D 02 
2 C.356SD QC Os Ry Ep 0 Os2 Cou rO 1 
3 =UmeocooD O00 0.25460 CO -—Onseere OL 
4 O2Lerovp ol Ont O0Sh— 01 OplSezepe0Z 
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TABLE XV 
VERSION 1 BEFORE WIPICS PENALTY COST 


sul CF DEPENDENT VARIABLE VALUES IS 0.32900 08 
owmece PRECICTED DEPENDENT VARIABLES IS 0.32510 08 
STANOARUC ERROR TG MEAN RATIO [S 0O.21820-01 

meen IS 0.92930 05 


ANALYSIS OF VARIANCE 


S@GWURCE SUM OF SQUARES DF MEAN SQUARE F STATISTIC 
USS 0.8223D 04 354 Qaz3250) 02 
RDM O.8178D C4 l 0O.8178D 04 ao 
TSSA 0.4563D 02 es) Osl2z 750-00 
RDB Q0.8222D 04 40 (OPA 0k o) Ban Or 51418.C761 
RDBA 0.4438D O02 a9 0. Peep OL 284.6449 
ERROR 0.82550 Ol BS 0.5998 0-02 


SOR IS O.S#250600 RSOR ADJUSTED 1S ~Gscecl0 QO 
fe STANDARD ERROR OF THE DEPENDENT VARIABLE iS O0.€223D—0% 


VARIABLE CCEFFICIENT STD .ERROK T Serres C 
l =U. 24200201 O.1042D 00 -0.23230 00 
Ze Q0.2419D O60 0.429520-01 On2 625) Cl 
2 ~C+9253D 00 0-4624D 00 -QO.20V01D Ol 
4 VezoloD oC 0. OU TS0s0L 0O.949€D Ol 
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TABLE XVI 


VeRso TON tls ACTER WERETCS PENALTY CGS) 


SsUr OF DEPENDENT VARIABLE VALLES IS 0.17640 08 
pemece PRECICTED CEPENDENT VARIABLES IS O.1751D 08 


STANCARC ERROR TO MEAN RATIO 1S O.2884D-01 
PEPN 1S 0.9142D 05 


SeuURCE SU ete SQUARES OF VOMEAN SQUARE oils ee 
Tess C.4494D C4 193 On232 90 G2 
RDM 0.4473D C4 l 0.4473D 04 7 oS aie Sage 
TSSA ec rolb. 02 Ge v4 Ol PISsebeo0 
RDB C.4494D C4 41 OsdseseD 03 oa) ae) egg | 
ROEA Oia O02 40 0.58220" 00 L54.51S7 
ERROR 0.523€D 00 WS) 0.3444D-02 


RSQR IS O0.-S760D CG RS@R ADJUSTED ITS O0.SES7ID O00 
five STARCARC ERR@R OF THE DEPENDENT VARIABLE IS OwS8ESD-01 


mereAoeE CCEFFICTIENT STD ERROR TeStAr rs TiC 
1 ey Sol 57 0) Blagg OMA On8292D-01 =-Ce3g0SGrau0 
2 =O orld LD 00 O.2586D 00 -OQser200 00 
3 eit ool Ol O-3717D 00 —OGaa92Z7070 
4 0.5933D OC O0.1110D CO Ons 4 ob Or 
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Tlie 1 1 
MEROLON Ze BEFORE WEPICS TOTAL CCST 
SUP CF OEPENDENT VARIABLE VALUES [IS 0.7979C O08 


mere cr PRECTCTED GCEPENDENT VARIABLES ITS —O37961D O08 


Bn ee ERRCR TO MEAN RATIO IS 0.65440-02 
PEAN [S$ 0.2254D OE 


ANALYSTS OF VARIANCE 


SQURCE SUM GF SQUARES DF MEAN SQUARE F STATISTIC 
SS Coe) 704 354 O221 SCR 0 2 
RDM C.9815D C4 1 O-9815D 04 aS ae re oe 
TSSA 0.-2666D 02 355 ONtea ee Url 
RDB 0.9842D 04 40 0.2460D 03 i aN 
ROBA O.2635) 02 Bis, C.6767D OC 185.6038 
ERRCR C221 050500 314 0.8614D-03 


RSGR IS 0.58990 00 RSOGR ADJUSTED 15 SOs geeu ce 
Mme o| AMEARD ERROR OF THE DEPENDENT VARIASLE TS 0.29250-01 


Weri ABLE COEFFICIENT STD ERROR T STATISTIC 
1 0.15710 OO 0.48220-01 O23 25 00 01 
2 Gaon 20 OC O..246960-C1 Ome 7 20) 02 
> 0.60670 OO ORES 25 0) 308, Ueoeeop, Ol 
4 Crag220 00 Oty eos tees Con Ot Onis ib vO 2 
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LA Bie ey ie 
VERSION 2 AFTER KIPICS TOOTH CCS 


Severce DEPENDENT VARIABLE VALUES IS 0.4516D 08 
Swell PRECLICTED CEPENDENT VARIABLES IS 0.4509D O8 


STANDARD ERRCR 10 MEAN RATIO IS C0.90S8D-02 
Vee 1S 0.2340D 06 


SOURCE SUMNGE SQUARES DE. VATEAN SQUARE F STAGSEIC 
SBS 0.5431D C4 193 0.2814D 02 
RDM 0.542CD 04 l 0.5420D 04 ae ee 
ies sA O.L125D O2 192 0.5859D—-G1 
RDB 0.5431 DeC4 41 0. top 032 5 See 
RDBA O.LILID 02 40 O. 20 aaa OO 29 Gene (3 
ERRGR C.1425D 00 be2Z 0.93 730-03 


RSQR IS 0.9$873D CO KSQR ADJUSTED IS Q.6840D O20 
fmeestTANCARD ERROR OF THE DEPENDENT VARIABLE 15 0O.20E€2D—-01 


VemweerokE CCEFPFICIENT STD ERROR T STAT SrTe 
] Ce4004D OC 0.4291 0201 059345 bor 
2 0.35390 O00 0O.422o0-=C1 0.836705 Cl 
5 -~C.4402D 00 O.133510 C0 0.330 
4 0.6656D OC O.62520— Om O, E@Sepr eZ 
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TABLE XIX 
Veto lO! BERORE WIPICS Gane SEG 


SUM CF CEPENDENT VARTABLE VALUES IS 0.468SD C8 

SUM GF PREDICTED CEPENDENT VARIABLES IS 0.4667D 08 
SeeoNCARC ERRCR TO MEAN RATIO IS O.1077D-Cl 

MEAN IS 0.1225D 06€ 


ANALYSIS OF VARIANCE 


SOURCE SUM OF SQUARES CF MEAN SQUARE F STAMMISTIC 
SS Q.9099D 04 354 Oe2oTUn: OZ 
RDM O.9081D 04 L 0.9081D 04 Bs Sri 
oA C.L827D C2 eye. Cero EDO 1 
RDB Q0.9098D 04 40 Q.22¢75D 02 ee 
RDBA On Tor p02 aS 0.4530D 00 236.0674 
ERROR Q.602ED O00 314 OstoloOR-O2 


eoagk IS 0.96700 O00 RSOR ADJUSTED 13 9O.Se270 00 
THE STANDARO ERROR OF THE DEPENDENT VARIABLE IS 0.43810-01 


VARIABLE CCEFFICIENT STD ERROR Le oA Tesiele 
l O62588D 00 On? le ib =0.1 Olen 210)" weg 
2 ee oro) 00 Os Seu 0 | On oc obeot 
S Csos70D OC OeZ2 een O00 C.-3677D Cl 
4 URours DOU 0.240/7D-Ol By yes sib) 0) 74 
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TABLE XxX 
Meal ose) FS OS eyed lee Ped (2 Geo sem (Bs Gras (eiGess 


sem OF DEPENDENT VARIABLE VALUES IS 0.27525°08 

pee CF PRELICTED CEPENDENT VARIABLES IS 0.2744D 08 
STANCARD ERROR TO MEAN RATIO IS’ O.1LEOD-Cl 

heen [5 0.1426D 06 


ANALYSIS OF VARIANCE 


SWURCE SUM OF SQUARES OE MEAN SQUARE F STAIITSTI¢é 
aS C.50500 C4 193 0.201 02 
RDM 0.5043D C4 l 0.50430 04 Pee ee ee 
TSSA Ce-/2070 Ol ioz2 0.3/54D-01 
ROB 0.505CD C4 41 0.12320 03 (435 5637 7 
RDBA 0.6956D Ol 40 Os17390400 104.¢9/88 
ERROR 0-2518D 00 koZ 0.1656D-02 


moGgk (IS OsSE51D COneRSOR ADJUSTER? TS 0.55530 200 
fije S1ANCARD ERROR OF THE DEPENDENT VARIABLE IS 0.40700-01 


MeepaeolLE CCEFFICIENT S?TD EREGR Pesta tir sire 
l Cecolr2) CC 0.5 (120-01 C.l1063C O2 
Z G2 0-0 t 0 .56220-—01 Cet os (0 00 
5 =Gr1es oy 00 O.-1TO9D 00 =ORees et bon 
4 C.1L006D Ol 0.83€4D-01 Ge E2030 "C2 
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The program produced predicted costs for each job, 
and then these costs were summed over the entire base cases. 
Each of the 10 separate models predicted two costs, one for 
ee and another for {Ay}. The results are given in Tables 
XXI through XXV. Costs are in millions of dollars, arranged 


according to Figure 3 below. 


Before WIPICS Model After WIPICS Model AGCeivia le=Cost 


Base predicted {B.] Predicted {B Aggregate Cost 





























eo. Cost Cost = of the jobs in 
M (pegged (htc ) (Standard Error) base case {By} 
{n } Predicted Ay Predicted A} Aggregate Cost 
M COs t Cost of the jobs in 


(Standard Error) } 





(Standard Frror) base case tAy 


Figure 3. Model Predictions. 


Standard errors reported are the standard errors of estimates 
of the mean of the aggregated base case costs in dollar terms 
as opposed to that which could be computed based on the loga- 
rithmic form of the data. That is, the standard error was 


defined as: 


ae 





m 

The tables are read, taking the upper right corner of Table 
foo for example, “If jobs {By} had been reworked during the 
after WIPICS period the aggregate cost would have been $41.25 


mal lion. * 
It appeared that the version 2 models did do a better 


job of predicting the actual costs of the base cases 
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corresponding to the periods from which the models were esti- 
mated than their counterparts in version l. 

be Versmen 1 

As shown in Table XXI, the before WIPICS Total 

Cost was predicted to be higher for both cases. Predictions 
fon case Lave are not significantly different. In Table XXII, 
mae case ee waS again predicted to be higher in Operations 
Cost in the before WIPICS environment, while case {A,,} showed 
the opposite result. Table XXIII depicting the Penalty Cost, 
reversed the pattern of the Operations Cost comparisons. If 
the Penalty Cost and Operations Cost tables were added, they 
would show parity for case {A,,3 and higher saeter WIPies 
predictions for {B,}. 

CG. wersion 2 

In Tables XXIV and XXV both Total and Operations 

Cost predictions for the base case {BS indicated less cost 
in the before WIPICS period. However, the base case tage 
showed the opposite result for both Total and Operations 
Cost, predicting that the after WIPICS period would be less 
costly. If the actual penalty costs for each base case were 
added to the predicted Operations Costs, the Total Cost 
results would be repeated as expected due to the computation 


of the penalty cost. 
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TABiRe AL 
VERSION 1, TOTAL COST, COMPARISONS 


Base Case Before WIPICS Model After WIPICS Model Actual Cost 









44.91 41.25 
{B.,} 46.19 
im 48) (.0362) 
A272 43.66 
ie } 45.58 
ov (.0546) (.0475) 


Millions of dol are 





TABLE XXII 
VERSION 1, -OPFRATIONS, COST, COME ARESO Vs 


Base Case Before WIPICS Model After WIPICS Model Actual Cost 






28.95 23.68 

i! Io: 
(.0156) (.0316) 
et re 

A. } 28.88 
M (.0243) (mona. 


(millions of dolars) 


TABLE XXIII 
VERSION 1, PENALTY COST, COMPARISONS 


Base Case Before WIPICS Model After Wipics Model Actual Cost 


ISAs 24S 
16.48 

Caleblesi(6h) (2031747) 

Tag ove cre 
16270 

(.0425) (0463) 


(millions of dollars) 
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TABLE XXIV 
VERSION 2, TOTAL COST, COMPARISONS 


Base Case Before WIPICS Model After WIPICS Model Actual Cost 








46.13 DO. 62 
{B,,) 

(.0112) (.0256) 
i) 45.97 44.12 
a O72 Jy) (0 299)) 









(millions of dollars) 


TABLE XXV 
VWERSION 2, OPERATIONS COll  COMezR re ehsS 


Base Case Before WIPICS Model After WIPICS Model Actual Cost 






29.59 34.87 

fey! 20 gi. 
(Omer ) (.0274) 
" 28.98 27.82 

1A} 28.88 
*M (.0246) (.0189) 


imi Llaions Of ~dotmlaiws)) 
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V. COMPARATIVE USEFULNESS OF THE MODELS 
iN COST=REPPECTIVEI PE SSe@ANALYSIS 

A. MODEL LIMITATIONS 

Each model chronicled in this thesis provides its own 
unique perspective on the question of cost-effectiveness. 
Comparisons among the models pointed out some of the limita- 
fens OL each, and also provided insight into possible 
remedies of those limitations. 

1. Linear Fconomic Models 

As a tool for validation, these models seemed to 

provide no definite answer. Using the same case data, they 
gave singly directed results compared to their continuous 
analogs, in Job Cost Models, which provided highly mixed 
results. The limitations of linearity for extrapolation be- 
came readily apparent when the models were tested using cases 
drawn from ranges quite different from those used to construct 
the model. Increased data to allow more homogeneous selection 
of base cases Soule tend to minimize this problem. The linear 
models used were not able to deal with inflation, in a manner 
such as version 1 of the Job Cost Models could. Expression 
of the resource coefficients for material and overhead in 
real monetary units would lessen this problem. Changing work 
type requirements could not be handled well by the aircraft 
linear model. However, the process Myers outlined for the 


engine pro sam would be better able to make the accommodations 
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for some of these time related changes by defining new processes 
mer each quarter. As Myers pointed out, the elustering method 
would require more data to he meaningful. 
2. Daily Cost Models 

Tye noted the major limitations for both models he 
examined [9, Chap.V]. These were the effects of: price 
changes for overhead and material cost, NORM redefinition, 
and changes in work required in terms of subprogram mix. He 
felt that these were not treated effectively by the models. 
He also noted the computational problem of the first stage 
regression of the CES function and the subsequent accuracy 
limitations. 

Sweooecost Models 

Both versions of the Job Cost Model were subject to 
unstable treatment of congection effects. The alternate 
explanation of pressure effects cast doubt over the exact | 
nature of the measurement. Possibly by forming the product 
of NIS and NDAYS, a variable would be created which indeed 
would measure congestion. This product would be a job density 
over the period of rework for the particular job considered. 
Substituting this composite measure for NIS in version 1 


Might provide more satisfactory results. 


EB. INTERPRETATIONS OF MODEL HARMONY OR DISCORD 

In developing cost-effectiveness criteria it was necessary 
to propose what was to be expected if indeed WIPICS had 
provided a cost savings for NARFNI. In other words, what 


conditions would be indicative of improvement in the facility's 
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cost flow or work flow? An extensive list of single items 
could be made, attacking a ceteris paribus condition to each. 
Such ceteris paribus conditions were clearly not likely, 

and hence the models attempted to take on the job of 
accounting for more than one changing condition at a time. 
ieewas Clear that if all of the different models that were 
used distinctly proclaimed the after WIPICS situation better 
by their own measures, there was firm ground for declaring 
WIPICS cost-effective. Only those known frailities of the 
models would have to be appended to the pronouncement as 
warnings. 

But what sort of second best situation might apply? 
Surely, if most models had indicated superiority of the after 
WIPICS situation and the others had indicated parity, a 
Similar cost-effective declaration would have been in order 
subject to minor reservations. Fven an element of opposite 
indications could have been tolerated if an explanation of 
the opposite effects better than that provided by WIPICS 
could be demonstrated. Naturally, these arguments apply 
equally well reversed for indications of a more costly or 
less productive after-WIPICS situation. 

But what of models that stood opposed to each other, 
firmly based? One might porpose a democratic, "majority 
wins," approach, but the answer would better lie in a 
thorough examination of model accuracy by measures of fit 
and variability accounting. The conflicting models would 


have to be checked for the assumptions on which they were 
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based, also. Further, any limitations of the models explana- 
tory abilities would also have to be weighed. Those factors 
not considered at all by each respective model would have 

to be evaluated. For fit and variance explanation, the 
measures of standard error and the coefficient of determina- 

iu mope (R*,R2) could be compared. Realism would provide a guage 
for the assumptions. Limitations and omissions would require 
judgments based on operational experience. 

Another possible situation can he constructed. This 
would be the situation where there existed not only inter- 
model conflict, but intra-model disagreement as well. This 
Situation would seem to be the best characterization of the 
results reported in this thesis. Far from being a discordant 
presentation of meaningless contradiction, however, the 
situation provided increased reason to believe that there 
were other factors to consider which had been omitted and 
that these factors were of some importance. At the same 
time some factors may be present that faithfully mask all 
attempts at isolating others that would be important and 
indicative. Some of the factors omitted and masking have 
been discussed above as limitations - such as inflation and 
better measures of congestion. Thus it would be appropriate 
to reconsider some of the structures used in the model 
development. 

An alternative explanation of the discord is possible. 

In an effort to maintain strict comparability between the 


linear model and the job cost model, the base cases used were 
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eee a re nee 


chosen to match by aircraft type/work type and to include as 
many observations in those cases as possible for more meaning- 
mul eCStimations. It 1s possible thatwin@dorng so the 
respective base cases were so atypical that they forced 
unlikely results. Some indications, notably by comparison of 
the production vectors expressed in terms of NORM, would 
provide good reason to hold this view. This could be checked 
by adding observations from another quarter and repeating 

the procedures. 

Returning to a situation in which WIPICS would have been 
deemed cost-effective on the basis of the models presented, 
it would be a natural extension to inquire about extending 
the use of WIPICS at other NARFs. The analyses would provide 
a valuable basis for considering such an extension, hut the 
methodology would be even more valuable in checking the 
desirability of such an extension. The methodology has 
provided a means for estimating the production and cost flows 
of a facility and could be used to determine if there was 
Suthicient similarity at the proposed location to make 
extension appropriate. If a model characterized the proposed 
activity as not being presently subject to congestive slow- 
jowas, this portion of the WIPICS @%cure ould probably “be 
lost. The models also provide a tool for planning. If, in 
mire face of budget réedUctions;mit wasmantrcepatecamenat NARE 
activities would b scaled down, this situation could be 
analyzed to determine whether the benefits of WIPICS would 
still be realized. This could be accomplished by using 


planned data as a base case for the models. 
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C.. EMPACT "OF OTHER FACTORS 

Tye's thesis and the present work used data to represent 
the after WIPICS period that began with observations very 
Meat the initiation of WIPICS. As Tye points out in his 
concluding chapter, WIPICS was not truly fully operational 
Smet October of 1972 [9, p. 47]. Even if it had been 
operational at the beginning of 1972, there would he suf- 
ficient reason to delay any denotation of an after-WIPICS 
period until after a long enough interval of time had passed 
Mie the system became routinely operational. Whe WEPICs 
related equipment required a learning period as would any 
mechanical device. Hence real effects would probably not 
be expected immediately. Ignoring work before, say, 1 July 
1972 would decrease the learning period effect. To accom- 
plish any meaningful results would again require additional 
later data. Each of the models would probably show clearer 
results from this extension. 

mach of the cost models primarily dealt wieneencprerca, 
cost figure for the basis of the analysis. Unfortunately 
the WIPICS effect, if any, might have been buried in doing 
so. It would probably be beneficial to eliminate from the 
cost accumulations, on both daily and job bases, the direct 
labor and material costs. By accounting definition and 
usage there would be little, if any, expected impact of 
WIPICS on these costs which constitute the largest share of 


the cost burden. WIPICS would have the largest impact on the 
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the overhead and penalty costs. Eliminating labor and 
material costs would also eliminate many of the additional 


problems and complications of explaining them. 
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Vi CONCLUSIONS AND vARPASSEORSEUTURE S2uUby 


ie CONCLUSIONS 

Previously described cost models of the NARFNI and their 
results concerning before and after WIPICS time periods were 
reviewed. Linear Economic Models were updated with more 
recent data to provide before and after WIPICS comparisons. 
Job Cost Models using dummy variables to account for differ- 
ing work types were introduced and exercised on before and 
after data. Comparisons of the models indicated extensive 
inter-models and intra-model conflict. It was concluded that 
this conflict indicated either missing explanatory factors or 
excessive extraneous detail of the modeis. Limitations and 
possible remedies were suggested for the models presented. 

The following table summarizes the conflict within and 
between the models. In this table the cost differentials 
have been computed as the before-WIPICS predicted cost minus 
the after-WIPICS predicted cost. Hence a positive value 
“ould indicate cost reduction predicted for the Giter-wiPics 
situation, and a negative value a cost increase. Tye's 
comparisons for the Daily Cost Models are added for further 


comparison. 


B. AREAS FOR FUTURE STUDY 
1. Myers provided a method for using clustering analysis 
to indentify processes that aided in structuring the engine 


program model. It would be possible to consider the work 
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TABLE XXVI 


COST PirrERENTIAL COMPARESONS 


Model Gost Conceunuction {B.} {aA} 


M M 
Linear Total Cost =5 oi —4en7 | 
Operations Cost =~ 364 ot) ORS, 
Penalty Cost Teo 7 a aie: 
mem, Version 1 Total Cost +3.66 +0.06 
Operations Cost +5 .27 -0.36 
Penalty Cost =8.68 gO ar, 
Job, Version 2 Total Coce -4,49 +1.85 
Operations Cost Seo 1G 
(Before (After 
WIPICS WIPICS 
Data) Data) 
Pamiy, Cobb-Douglas +17,885 +9,241 
baaily, CES + 3,306 +7 ,129 





Values are millions of dollars for the Linear and Job models 
and dollars per day in the daily models. 


types alone rather than the aircraft type and work type 
together to develop fewer categories and possibly produce more 
than one process among those work types. There appeared to 
be some indication of similarity among aircraft, especially 
where they differ only by model or special Cont Ltouration. 
This might provide additional information concerning alterna- 
tive resource utilizations and allow sensitivity analysis of 
the aircraft program effort. 

2. The engine program since it was not affected by WIPICS 


implimentation provides a standard for control. The engine 
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program job mix would probably fluctuate in a manner similar 
to the aircraft program. The effects of the level of activity 
on production rates could be investigated. The impact of 
growth in NORM could be examined for effects on the ability 
Powpredict a valid functional relationship. Although the 

two programs have been treated as independent to date. any 
interface between aircraft and engine programs might be 
investigated. This interface could especially be checked 

for interference with WIPICS. Conclusions drawn about 
changes in engine program productive factors might shed light 
on similar factors within the aircraft program which are 
changing wholly outside of WIPICS influence. The aircraft 
program might be then reexamined with the highlighted factors 


diminished or deleted. 
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APPENDIX A 


JOB COST MODEL REGRESSION AND PREDICTION PROGRAM 


eee FURPOSE 

This program provides regression equation coefficients 
and statistics for a log-linear model of the job cost flow 
at NARFNI using as a basis the actual observations of job 
Financial records. Data used is that contained in the Produc- 
tion Performance Reports issued quarterly by NARFNI. The 
program continues beyond the regression, if desired, to 
predict values of various cost constructions based on the 
equation estimated by the regression procedure. Additional 
data sets of actual data may be used for the prediction, in 
which case comparison may be made between actual and predicted 
values. Alternatively, hypothetical or planning data may 
be used for the prediction, in which case the predicted cost 


values would serve a budgeting function. 


De INPUTS 

A header card, five contro! cands, and two daca Ssecseare 
required for the regression procedures. Additional sets of 
data may be included as desired for prediction. In the 
@escriptions that follow, "CC™ indveatec card = column onea 
computer punch card. 

1... Heager Card: 


cc 1-40 Any alphanumeric title of heading for 
the model 
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es 


oe 


4. 


CC 41-42 The number of additional sets of 
data to be used for prediction, 
S29 ; Plaieeguisei tied 4 wsthic wt tela. 
Zero or blank indicates no predic- 
EVons 


CONLrolcaras 


first: CC 1-4 The numbersof texplenatory, variances 
to be used in the regression. (72) 


Cer. Zero (blank) convenes ar cexciicien 
or inclusion, respectively, of the 
penalty cost computation from the 
desired cost construction ("NOGO") 


CC 9-12 The number (< 1600) of data cards 
for the regression plus one. 
("“NSTOP") 


Cc 13-16 The value, separately computed, to 
be used in prediction for those 
Jobs lying in “eat pemiode to 
indicate average number in shop. 
("NIS") May be blank if predic- 
tion is not desired. 


second: The twenty two-digit aircraft type codes, 
in numerical order, without spaces 
between. ("IMATR" ) 


thard, fourth, £1fth Cards - se penatc, COSsts per da, 
for the aircraft types identified in the 
second control card above, in the same 
order. ("PMAR) Thirds@anc fourth card 
contain eight nine-digit fields, one 
place of which may be a decimal point. 
The £ifth Cara Contarnea the remarnind 
four nine-digit fields. 


Aggregated Prorated Data Deck 


The output from the Aircraft Prorate Program 
[ref. 8, App. PD) from Julian date 0069 through 
the highest production date. Add one blank card, 
if there is a non-zero number in shop on the last 
day. 


Regression Data 


Raw data cards in the format given by Myers [8, 
App. Al. Cards vare “in order by aueerci ewe 
and, within aircraft type, by work type. Exactly 
NSTOP-1l cards must be entered. 
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5. Emedacel on slata 
As many additional decks as indicated on the 
header card may be included. Repeat the set of 
control cards, adjusting the first card to match 


the prediction data set in number of cards and 
NIS value. The Aggregated data is not repeated. 


ce CUrPUTS 

Statistical results and a list of computed estimates for 
the dummy and explanatory variables are printed for the 
regression procedures. Fach step of the stepwise procedure 
is printed. For the prediction procedures, the predicted 
values of the input jobs are accumulated and the total is 
printed along with the total actual value and statistical 


parameters. 


im oPECIAL NOTES 

Construction of the particular cost dependent variable 
is done in the Read subroutine, where one of the two sen 
statements is chosen depending on the construction desired. 
Changes between versions are made by interchanging the card 
Ux(J,2)=..." in the same subroutine. Fxpansion of the 
program for increased number of explanatory variables and 
data cards can be accomplished hy increasing appropriate 
DIMENSION values. The subroutine LOC is also required from 
the IBM Scientific Subroutine Package. 

The author wishes to thank Assistant Professor Norman Kk. 
Womer, formerly of the Naval Postgraduate Senool-for con 


tributing the computer program appearing in this Appendix. 
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